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I.  IWnCDOCTION 


The  advent  of  low-cost  processors  has  made  the  construction  of  highly 
complex,  decentralized  systems  feasible.  These  systems  are  usually  divided 
into  interacting  components  which  operate  concurrency  and  coordinate  their 
operations  by  using  an  asynchronous  protocol.  Petri  Nets  have  frequently 
been  used  to  model  such  systems  since  they  can  model  concurrency  and 
asynchronous  protocols  [10] .  Specific  examples  of  systems  modeled  by  Petri 
Nets  include  computer  systems  [11],  communication  protocols  [4]  and 

f 

manufacturing  systems  [5]. 

One  aspect  of  designing  these  complex,  concurrent,  asynchronous  systems 
is  predicting  their  performance  with  respect  to  time  related  measures. 
These  measures  could  include,  but  are  not  limited  to,  throughput,  backlog, 
the  probability  that  a  shared  resource  is  free  at  any  given  time,  the 
average  time  it  takes  to  conplete  each  particular  task,  etc.  In  order  to 
use  Petri  Nets  to  predict  these  performance  measures,  the  notion  of  time 
must  be  added  to  the  original  definition.  Several  authors.  Ramchandani 
[12],  Sifakis  [13],  and  Ramamoothy  and  Bo  [11],  have  studied  Deterministic 
Timed  Petri  Nets,  where  deterministic  processing  times  have  been  added  to 
model  fixed  delays.  Stochastic  Timed  Petri  Nets  (STPNb)  have  been  studied 
by  Zuberek  [14],  Molloy  [8],  and  Marsan,  et.  al.  [7].  All  of  these  authors 
perform  the  analysis  by  transforming  the  problem  into  an  equivalent  Harkov 
Chain,  whose  steady  state  probability  distribution  is  then  found  by 
conventional  techniques.  Since  the  numbers  of  states  in  the  chain  tends  to 
grow  exponentially  with  the  size  of  the  net.  their  techniques  are  limited  to 
solving  relatively  small  problems. 


In  this  paper,  we  will  show. how  the  performance  of  a  simple  subclass  of 
STPNs,  that  of  Stochastic  Timed  Decision-Free  Petri  Nets  (STDFPNs) ,  can  be 

predicted.  This  subclass  can  model  concurrency  and  coordination,  but  not 

/ 

decisions,  and  have  been  used  to  model  certain  manufacturing  systems  [5], 
The  major  contribution  is  a  new  analysis  technique  which  uses  a  set  of 
equations  that  describe  the  behavior  of  the  system.  (These  are  the  same 
equations  that  Dubois  and  Stecke  [5]  used  to  analyze  the  deterministic 
case) .  The  resulting  algorithms  are  cocputat ionally  more  attractive  and  the 
general  approach  can  be  extended  to  study  less  restrictive  classes  of  STPNb. 

An  overview  of  this  paper  goes  as  follows.  We  start  by  defining  STPNs 
and  presenting  the  relevant  concepts.  Then,  the  study  is  limited  to 

r  ‘  *  1 

STDFPNs.  NT  examine  .three  related  processes  which  describe  firing  times, 

r 

relative  firing  times,  and  intertransition  times.  The  first  process 
introduces  the  new  analytical  technique,  the  second  one  provides  a 
convergence  proof,  and  the  third  one  allows  performance  measures  of  interest 
to  be  computed. 
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Stochastic  Tis^d  Petri  Nets  are  graphs  with  two  types  of  nodes:  places 
(dram  as  a  circle  and  labelled  p^)  and  transitions  (dram  as  a  line  segment 
and  labelled  t^) ,  and  directed  arcs  going  from  one  type  of  node  to  the  other 
(see  Figure  l).  Besides  nodes  and  arcs,  a  STPN  assigns,  to  every  place,  a 
nonnegative  lumber  of  tokens,  called  the  marking  of  the  net,  and  a 
nonnegative  randan  processing  time1.  When  a  token  arrives  at  a  place,  it  is 
defined  to  be  unavailable  (following  Sifakis  [10]).  The  token  remains  in 
this  state  until  the  instant  when  the  processing  has  finished.  At  this 
time,  the  token  becomes  available.  Initially,  all  tokens  are  assumed  to  be 
unavailable. 

Tokens  move  around  by  transition  firings.  A  transition  is  enabled, 
that  is,  it  may  fire,  only  when  all  of  its  input  places  have  available 
tokens.  When  a  transition  does  fire,  it  removes  a  token  from  all  of  its 
input  places  and  adds  a  token  to  all  of  its  output  places.  TWO  or  more 
transitions  are  said  to  be  in  conflict  if  firing  one  will  disable  the 
others.  If  an  enabled  transition  is  not  in  conflict,  it  fires  instantly. 
If  several  enabled  transitions  are  in  conflict,  then  a  decision  rule, 
specified  a  priori,  selects  one  and  that  transition  fires  instantly.  Thus, 
once  the  graph,  the  initial  marking,  processing  times  and  decision  rules  are 
specified,  the  STPN  evolves  autonomously  in  time. 

One  can  think  of  the  operation  of  a  STPN  as  a  succession  of  markings, 
with  the  transitions  from  one  marking  to  another  specified  by  the  transition 


1Many  authors,  Bamchandani  [12],  Zuberek  [14],  and  Molloy  [8],  associate 
processing  times  with  transitions  instead  of  places.  The  distinction  makes 
no  difference  for  the  class  of  problems  studied  in  this  paper. 


firings  and  the  rules  for  moving  tokens.  If  the  number  of  tokens  in  any 
particular  place  can  never  exceed  one.  regardless  of  what  processing  time 
probability  distributions  and  decision  rules  are  assigned,  the  STPN  is  said 
to  be  safe.  If  there  exists  a  Tj  for  any  transition  tj  and  for  any  t>0  such 
that 

Prob (transition  tj  will  fire  before  tj}  >  1-* 

regardless  of  what  marking  the  net  has  reached,  the  STPN  is  defined  to  be 
live.  And  finally,  if  there  exists  a  directed  path  from  any  node  (place  or 
transition)  to  any  other  node,  the  STPN  is  strongly  connected.  Throughout 
this  paper,  we  will  assume  that  the  STPNs  we  are  studying  are  strongly 
connected,  live,  safe,  and  with  a  finite  number  of  nodes. 


NETS 


Stochastic  Timed  Decision-Free  Petri  Nets  cure  STPNs  in  which  every 
place  has  exactly  one  input  and  one  output  transition  (see  Figure  2  for  an 
example).  Thus,  transitions  are  never  in  conflict  and  decisions  rules  are 
not  needed.  This  fact  makes  SEDFPNs  much  easier  to  analyze  than  broader 
subclasses  of  STPNs.  but  also  inposes  a  modeling  limitation  since,  as  noted 
previously,  they  connect  model  decisions.  They  can,  however,  model 
concurrency  and  coordination.  The  performance  measures  that  we  are 
interested  in  obtaining  cure  the  steady  state  firing  rate  of  every 
transition,  the  steady  state  number  of  tokens  in  every  place,  and  the  steady 
state  delay  a  token  encounters  in  every  place. 

But  before  we  proceed,  let  us  review  the  pertinent  results  of  Decision- 
Free  Petri  Net  (DFPN)  theory,  or  SXDFPNS  without  the  processing  times. 
These  Petri  Nets,  also  called  Harked  Graphs  in  the  literature,  have  been 
extensively  studied  [3],  [9],  with  most  of  the  work  centering  around 
establishing  liveness  and  safeness  conditions.  The  results  that  are 
important  for  our  study  are: 


The  number  of  tokens  in  a  directed  circuit  does  not  change  as 
a  result  of  transition  firings. 


A  DFPN  is  live  iff  the  number  of  tokens  in  every  directed 
circuit  is  positive. 


(iii)  A  live  marking  is  safe  iff  every  place  is  contained  in  a 


directed  circuit  with  a  token  count  of  one 


Vie  will  now  show  that  these  results  also  hold  true  for  STDFPNs  by 
showing  that  they  are  live  and  safe  iff  the  underlying  DFPNs  are  live  and 
safe.  The  safeness  equivalence  is  true  by  definition.  The  liveness 
equivalence,  however,  oust  be  proved.  To  that  effect  let  z^(k)  be  the 
processing  time  for  place  p^  for  the  k^1  token  to  arrive  at  that  place.  We 
will  assume  that  there  exists  a  x  such  that 

Prob(z^(k)  <  x}  >  l-« 

for  any  «>0,  regardless  of  the  numerical  values  of  the  other  service  times 
(a  mild  independence  condition). 

Proposition  1.  Given  the  processing  time  assunption  mentioned  above,  a 
STDFPN  is  live  iff  the  underlying  DFPN  is  live. 

Proof:  If  the  STDFPN  is  live,  then  there  exists  at  least  one  sequence  of 
transition  firings  and  a  x  such  that,  for  any  transition  tj  and  any  e>0, 

Prob (transition  tj  will  fire  before  x)  >  «. 

The  same  sequence  of  transition  firings  is  valid  in  the  underlying  DFPN, 
which  shows  it  is  live. 

Assume  the  underlying  DFPN  is  live.  The  liveness  proof  given  by 
Commoner,  et.al  (3]  ensures  that,  for  any  particular  transition  tj,  there 
exists  a  circuit-free  backtracking  subgraph  such  that  at  least  one  of  the 


transitions,  call  it  t^.  contains  tokens  in  all  of  its  input  places.  By  the 
assumption  on  the  processing  times,  there  exists  a  such  that,  for  any 
*>0. 

Prob (transition  will  fire  before  >  l-«. 

A  similar  argument  can  then  be  given  for  all  other  transitions  along  the 
subgraph.  Thus,  there  exists  a  Vj  for  any  «>0  such  that 

Prob  (transition  t^  will  fire  before  }  >  i-« 
which  shows  the  STDFPN  is  live. 

Q.E.D. 

As  can  be  noted  from  the  listed  results,  directed  circuits  play  an 
inportant  role  in  the  study  of  STDFPNs.  It  is  useful  to  think  of  the 
operation  of  a  STDFPN  in  terms  of  an  equivalent  circuit-free  unfolded 
STDFPN.  This  unfolded  net  consists  of  an  infinite  nunber  of  identical 
stages,  each  of  which  is  formed  by  breaking  the  regular  STDFPN  immediately 
before  every  place  containing  a  token  in  the  initial  marking  and  'unfolding* 
the  net.  For  example.  Figure  3  shows  the  Uhfolded  STDFPN  that  corresponds 
to  the  STDFPN  shown  in  Figure  2. 

A  formal  procedure  to  construct  one  stage  of  the  unfolded  STDFPN  is 
given  by  Algorithm  1.  In  this  algorithm,  the  variable  k  represents  the 
stage  and  the  transition  firings  are  symbolic ,  not  actual  transition  firings 
of  the  STDFPN.  We  also  denote  the  set  of  input  (output)  places  to 


transition  t^  by  *t^  (tj),  as  comnonly  done  in  the  literature  [12],  [13]. 
Algorithm  1:  Construction  of  one  stage  of  the  unfolded  STDFPN 

INITIALIZED:  H  to  Mg  (initial  marking) 

-  t{|  Ct^  |t^  is  enabled  by  M) 

-  Pfc  <-  [pj  |pj  contains  a  token  in  M] 

-  Create  a  place  p^  for  all  PjcP^ 

DO  UNTIL  «  0 

-  For  every  transition  t^«T^ 

(a)  Create  a  transition  t![ 

(b)  Direct  an  arc  from  p!j  to  t*£  for  every  pje*ti 

(c)  Create  a  place  for  every  Pj«t{ 

If  Pj  ‘Pjq 
THEN 

Label  the  place  p^+1 

ELSE 

Label  the  place 
Pk  Pj 

ENDIF 

-  Fire  all  transitions  teT^j 

-  update  M,  T*M 


ETOUNTIL 


It  can  be  shown  by  using  an  argument  similar  to  the  liveness  proof 
given  by  Commoner,  et .al.  [3]  that  Algorithm  l  fires  every  transition  exactly 
once.  Me  also  note  that  the  marking  at  the  end  of  the  firing  sequence  is 
the  same  as  the  initial  marking  since  every  transition  has  been  fired  the 
same  lumber  of  times  (Murata  [9].  Property  2).  Thus,  all  stages  are 
identical  except  for  the  variable  k. 

Besides  constructing  a  stage  of  the  Unfolded  STDFPN,  Algorithm  l  also 
provides  a  partial  order  among  transition  firings.  Before  a  transition  can 
fire,  it  must  have  tokens  in  all  of  its  input  places.  When  a  transition 
comes  up  in  the  partial  order  established  by  the  algorithm,  all  of  its  input 
places  do,  in  fact,  contain  tokens. 

Visualizing  the  operation  of  STDFPN  in  terms  of  its  unfolded  equivalent 


is  not  only  convenient,  but  it  is  also  exact.  Me  will  show  that  the  two 
systems  are  dynamically  equivalent  after  we  derive  the  firing  time  state 
equations,  which  we  do  next. 


IV.  FIRING  TIME  STATE  EQDftTIONS 

Given  a  STDFPN,  a  natural  question  to  ask  is  the  time  at  which  the  k*-*1 
firing  of  each  transition  will  occur.  TO  this  objective,  consider  the 
STDFPN  shown  in  Figure  4  and  assume  that  the  initial  narking  does  not  place 
a  token  in  either  p2  or  Pj.  Then,  if  we  let  x^(k)  be  the  time  of  the  k^1 
firing  of  transition  tj_, 

x3(k)  -  max{z1(k)  +  x2<k).  z2(k)  +  x2(k)l  (D 

where  z^(k)  is  the  processing  time  of  place  p^  for  the  k^1  token  that 
arrives  to  that  place.  Note  that  this  type  of  equation  can  be  written  for  a 
STDFPN  even  if  it  is  not  live  or  strongly  connected. 

Now.  assume  that  the  net  shown  in  Figure  4  is  part  of  a  larger  STDFPN 
that  is  strongly  connected,  live  and  safe.  Equation  (l)  holds  as  long  as 
the  initial  marking  does  not  place  a  token  in  p2  or  P2.  If  the  initial 
marking  places  a  token  in  p2,  but  not  pj,  then 

x3<k)  *  max(z1(k)  +  x^k-l).  z2(k)  +  x2(k)}  (2) 

where  Xi(0)  *  0.  Ibis  equation  is  consistent  since  the  liveness  and 
safeness  assumptions  ensure  that  p2  is  contained  in  a  directed  circuit 
containing  one  token,  which  implies  that  x1(k-l)  i  xj(k)  i  xj(k)  for  all  k. 
Similarly,  if  the  initial  narking  places  tokens  in  both  p2  and  p2*  then  we 

^These  equations  are  used  by  Dubois  and  Stecke  [51.  but  not  derived.  Since 
they  are  important  for  this  paper,  we  present  a  more  formal  derivation  and 
show  that  they  are  consistent. 
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conclude  that 

x3(lc)  -  maxCZjdt)  +  x^k-1),  z2(k)  +  x2<k-i))  (3) 

In  this  discussion,  we  have  considered  a  transition  with  only  two  input 
places.  If  there  had  been  more,  then  the  maximization  operator  of  the  state 
equation  would  have  included  more  terms,  but  could  still  be  easily  written. 
Thus,  firing  time  state  equations  could  be  obtained  for  every  transition  in 
a  STDFPN  in  the  manner  discussed  above.  Figure  5  gives  an  example  of  a 
STDFPN  and  its  corresponding  firing  time  state  equations. 

Given  the  processing  times,  the  state  equations  could  be  used  to 
calculate  the  transition  firing  times  recursively.  These  calculations  would 
have  to  be  performed  in  the  proper  order  to  satisfy  all  the  causality 
constraints.  As  noted  previously,  any  order  consistent  with  the  partial 
order  provided  by  Algorithm  1  satisfies  these  requirements.  The 
calculations  would  also  have  to  be  initialized  properly.  This  can  be  dene 
by  setting  x^(0)  -  0  for  all  places  p^.  This  is  consistent  with  our 
assumption  that,  initially,  all  tokens  are  unavailable. 

We  mentioned  previously  that  the  visualization  of  the  operation  of  a 
STDFPN  in  terms  of  its  equivalent  Unfolded  STDFPN  was  not  only  convenient, 
but  also  exact.  We  now  elaborate.  By  using  the  state  equations,  we  will 
show  that  the  two  systems  are  dynamically  equivalent.  That  is,  we  will  show 
that  there  exists  a  one  to  one  correspondence  between  the  transition  firings 
and  processing  times  of  the  two  systems  such  that  the  related  transition 
firings  occur  at  the  same  time  provided  the  related  processing  times  are 
equal.  To  this  effect,  let  G  be  a  £7IDFPN  and  UG  be  its  corresponding 
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infolded  STDFPN.  Then,  we  specify  that  the  initial  narking  in  OS  is  a  token 
in  every  place  p^,  where  p^  contains  a  token  in  the  initial  marking  of  G. 
Now  for  the  proposition. 

Proposition  2:  The  dynamic  evolution  of  a  STDFPN  is  equivalent  to  its 
corresponding  Unfolded  STDFPN. 

Proof:  If  we  associate  Xj(k)  and  Zj(k)  with  the  transition  fcjj  and  place 
of  the  Unfolded  STDFPN,  respectively,  then  the  state  equations  for  the 
STDFPN  and  its  corresponding  Unfolded  STDFPN  are  identical. 

Q.E.D. 


The  dynamic  behavior  of  a  STDFPN  is  difficult  to  understand  based  on 
the  state  equations  as  given.  To  improve  this  situation,  we  will  show  that 
the  state  equations  can  be  expanded  so  that  the  k^  firing  time  of  any 
transition  depends  only  on  the  k-1  firing  times  of  other  transitions.  Then 
we  will  show  that  the  resulting  equations  can  be  written  in  matrix  form  by 
converting  them  to  a  (max,-*')  algebra . 

As  seen  from  the  derivation  of  the  firing  time  state  equations,  the  k***1 
firing  of  any  particular  transition  tj  depends,  in  general,  on  the  k-1  or 
k*-*1  firings  of  other  transitions.  By  repeatedly  substituting  the  k**1 
firings  times  of  these  other  transitions,  the  equations  can  be  expanded  so 
that  they  depend  only  on  the  k-1  firing  times  of  other  transitions  and  on 
the  k^  service  times  of  several  places.  The  repeated  substitution 
procedure  corresponds  to  tracing  backwards  along  all  paths  in  the  Unfolded 
STDFPN,  starting  from  t!j  and  ending  at  transitions  in  the  previous  stage. 


Since  the  Chfolded  STDFPN  contains  no  directed  circuits,  these  backtracking 
paths  are  guaranteed  to  end  in  the  previous  stage  and  are  finite.  And  all 
places  that  appear  along  the  path  correspond  to  the  k^1  stage  of  the 
enfolded  STDFPN.  Therefore  only  z^(k)  terse  appear  in  the  state  equations 
for  Xj(k),  and  no  z^m),  m<k,  terse  appear. 

To  make  the  structure  of  these  equations  clearer,  substitute  the  max 
operation  by  (+)  and  +  by  ©  ,  as  done  in  [51.  if  we  let  x(k)  be  the 
vector  for  the  k**  firing  time  of  all  transitions,  then  the  discussion  on 
repeated  substitution  and  some  algebraic  manipulations  shows  that 

x(k)  -  A[z(k)l  O  x(k-l)  (4) 

there  A[z(k)l  is  a  matrix  whose  ccoponents  are  functions  of  z(k),  the  vector 
of  processing  time  variables,  and  the  matrix  multiplication  is  in  the  sense 
of  (+)  and.  ©  operators.  The  assumption  that  all  tokens  are  initially 
unavailable  inplies  that  x<0)  -  0,  the  vector  of  all  zeroes. 

Cohen,  et.al.  [2]  analyzes  systems  which  have  state  equations  of  the 
form  given  in  (4).  but  with  deterministic  processing  times.  Dubois  and 
Stecke  [51  take  this  approach  to  analyze  Deterministic  Timed  DFPNs.  we  will 
also  use  some  of  their  results. 

So  far,  in  this  section,  we  have  spent  a  lot  of  time  obtaining  and 
clarifying  the  structure  of  the  firing  time  state  equations.  Since  the 
processing  times  are.  in  general,  random  variables,  it  is  necessary  that  we 
try  to  characterize  the  probability  distribution  for  x(k),  which  we  denote 
by  fx(k)(x).  To  keep  the  calculations  from  getting  arbitrarily  cooplex,  we 
assume,  from  this  point  on,  that  the  processing  times  are  independent  random 
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variables  over  the  stages.  With  this  assumption,  we  can  show  the  following. 

Proposition  3 .  If  the  z(k)  are  independent  random  vectors  over  k,  and 
indepenent  from  x(0) ,  then  the  process  (x(k),  k«NJ  is  Markov. 

Proof;  Follows  from  equation  (4)  and  the  independence  assumptions. 

Q.E.D. 

Thus,  the  vector  of  firing  times,  x(k),  constitutes  the  state  of  a 
Markov  Process.  This  conclusion  is  intuitive  if  one  realizes  that  the 
transitions  whose  firing  times  are  included  in  x(k)  constitute  a  cut  set  in 
the  Unfolded  STDFPN.  The  Markov  property  also  inplies  that  one  can  use  the 
firing  time  state  equation  to  calculate  fx(k) (x)  starting  from  fx(o) f°r 
all  k.  This,  however,  may  not  be  the  indicated  course  of  action.  The 
variance  for  any  particular  x^Ck)  will  increase  without  bound  as  k 
increases,  as  we  can  convince  ourselves  by  considering  a  very  sinple  STDFPN 
containing  one  transition  and  one  place  connected  in  a  loop  and  with  a 
random  processing  time.  Furthermore,  we  know  of  no  way  in  which  to 
characterize  fs(k)  (x)  as  k  goes  to  infinity  by  using  some  central  limit 
theorem  or  assuming  some  clever  probability  for  the  processing  times. 

Thus,  we  cannot  use  fx^k>  (x)  to  obtain  the  desired  performance  measures 
since  the  probability  distributions  do  not  converge.  To  correct  this 
situation,  we  will  do  a  few  things.  First,  we  will  derive  the  relative 
firing  times  process  and  show  that  the  probability  distributions  that 
characterize  it  will  converge  by  making  some  additional  assumptions  on  the 


processing  times,  then,  we  will  define  the  intertransition  times  process, 
show  that  the  probability  distributions  that  characterize  it  will  converge 
by  relating  it  to  the  relative  firing  times.  And  finally,  we  will  show  how 
the  performance  measures  can  be  obtained  from  the  steady  state  probability 
distributions  of  the  intertransition  times. 


The  relative  firing  times  are  obtained  by  performing  a  transformation 
on  the  firing  times.  To  that  effect,  pick  a  transition  tr  to  be  the 
reference  transition.  Then  w(k),  the  vector  of  relative  firing  times,  is 
defined  by 

w(k>  -  x(k)  -  xr<k)l  (5) 

where  1  is  a  vector  of  ones  and  xr(k)  is  the  k**1  firing  time  of  the 
reference  transition.  Me  can  also  represent  this  transformation  in  (max.  +) 
algebra  as  follows 

w(k)  -  [xr(k)]-1  O  x(k)  (6) 

where  [*]-1  denotes  subtraction  in  the  usual  algebra .  As  can  be  seen  from 
this  last  equation,  the  transformation  performed  on  x(k)  to  obtain  w(k)  is  a 
scaling  operation  in  the  (max.+)  algebra  domain.  In  the  paragraphs  that 
follow,  to  clarify  the  discussion,  we  let 

w(k)  -  SIx(k)l  (7) 

represent  the  transformation  indicated  by  equations  (5)  and  ((). 

In  order  for  this  transformation  from  x(k)  to  w(k)  to  be  useful,  it 
must  be  well  defined.  That  is.  we  must  show  that  the  derivation  of  w(k+i) 
from  x(k+l)  using  the  definition  is  equivalent  to  deriving  w(k+l)  from  w(k) 
using  a  state  equation  for  the  relative  firing  times  process.  Me  do  this 


Proposition  4.  The  transformation  from  x(k)  to  w(k)  is  well  defined,  that 
is. 

S[x(k+l)l  -  S{A[z(k)]  ©  Stx(k)] J  (8) 

Proof3;  By  the  definition  of  relative  firing  times,  we  have  that 

S[x(k+1)]  -  Atz(k)]  O  x(k)Q  (a^[z(k)]  ©  x(k))"1*  x  (kjQx^tk) 

-  A[z(k)]  ©  x(k)  ©  x^Ck)  ©  Ca^EzCk)]  ©  x(k)  ©  x^tk)}-1 

*  A[z(k)]  ©  S(x(k)l  ©  {a^(k)]©  Slx(k)]}-1 

*  StAtz(k)]  ©Slx(k)]}  (10) 

which  is  what  we  wanted  to  show. 

Q.E.D. 

Expanding  the  last  equation,  we  obtain  the  state  equation  for  the 
relative  firing  times  process 


3This  proof  uses  (max,+)  algebra  results  which  can  be  verified  by  converting 
back  to  the  usual  algebra  or  by  consulting  [2]. 


w(k+l>  -  A[z(k)l  O  w(k>  O  Ca^[z(k)]  Q  w(k)J 


(ID 


With  this  state  equation,  we  can  prove  the  following  proposition. 

Proposition  3 .  If  the  z(k)  are  independent  random  vectors  over  k.  and 
independent  from  w(0),  then  the  process  Cw(k),  k«NJ  is  Markov. 

Hi  is  conclusion  is  not  surprising  if  we  remenber  that  the  transitions 
whose  relative  firing  times  are  contained  in  w(k)  form  a  cut  set  of  the 
Ohfolded  STDFPN.  The  transformation  S(  * )  subtracts  the  absolute  value  of 
time,  and  this  has  no  effect  on  the  Markov  property.  The  transformation 
does,  however,  provide  us  with  some  nice  convergence  properties,  as  we  will 
see  next. 
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VI.  PROPERTIES  OF  THE  REIATTVE  FIRING  TIMES  MARKOV  PROCESS 

In  this  section,  we  analyze  the  consequences  of  making  further 
assumptions  on  the  processing  times.  First,  if  we  assume  that  the 
processing  times  are  bounded,  we  will  show  that  the  state  space  is  bounded. 
In  turn,  if  we  assume  the  processing  time  probability  distributions  are 
stationary  and  in  discrete  time,  we  will  show  that  the  resulting  Markov 
process  has  a  single  recurrence  class,  Then,  we  will  conbine  all  of  the 
assumptions  stated  above,  and  analyze  the  consequences. 

So.  first  assume  that  the  service  times  are  bounded  for  all  places  and 
for  all  k.  By  incorporating  this  assumption  into  the  liveness  proof  given 
by  Camnoner,  et.al.  [3],  we  can  show  that  the  time  to  fire  any  particular 
transition,  from  all  possible  markings,  is  bounded.  Call  this  bound  t.  we 
can  also  show  that  a  strongly  connected  STDFPN  can  be  considered  as  the 
union  of  a  finite  number  of  directed  circuits,  each  containing  one  token, 
this,  in  turn,  leads  us  to  conclude  that  the  number  of  times  any  particular 
transition  fires  differs  from  the  number  of  times  any  other  transition  fires 
by  less  than  some  finite  number.  Let  this  number  be  L.  Now,  consider  the 
STDFPN  at  any  instant  of  time  when  the  reference  transition  tr  fires,  say 
for  the  k**  time.  Let  tj  be  any  other  transition.  We  know  that  the  number 
of  times  transition  tj  has  fired  differs  from  k  by  at  most  L.  We  also  know 
that  the  time  between  tj  firings  is  at  most  t.  Therefore 

|xr<k)  -  Xj(k)J  1  *L  (12) 


Thus,  every  element  of  w(k)  is  bounded.  We  have  just  shown  the  following: 


21 


Proposition  6.  If  all  elements  of  zOc)  are  bounded  for  all  k,  then  all 
|  elements  of  w<k)  are  bounded  for  all  k. 

Now  assume  that  the  processing  times  j(k)  sure  identically  distributed 
I  over  k  and  in  discrete  time.  If  a  value  of  %  for  which  fz(£)  >  o  occurs 

enough  times  in  a  row.  then  the  results  of  Cohen,  et.al.  [2]  tell  us  that 
the  firing  times  of  all  the  transitions  will  become  periodic  modulo  a 
i  constant,  regardless  of  what  numerical  value  the  initial  firing  t in***  had. 

That  is,  for  any  x(o),  there  exists  finite  ko.  k  and  d  such  that 

£(k+d)  «  dkl  +  *(k)  (13) 

for  all  kl|c0.  The  x(k)'s  related  by  this  equation  are,  in  fact,  the  same 
|  state  in  the  relative  firing  times  Markov  process.  Thus,  if  Z  occurs  k0 

times  in  a  row.  an  event  which  occurs  with  probability  [fz(Z))lcO  >  0,  the 
relative  firing  times  Markov  process  will  be  in  a  set  of  periodic  states, 
j  and  will  remain  in  these  states  as  long  as  the  value  of  Z  keeps  occurring. 

To  analyze  the  consequences  of  making  the  specified  assunptions 
further,  let  us  define  deterministic  states  to  be  the  states  of  the  relative 
firing  times  Markov  process  which  can  be  reached  by  repeating  any  particular 
value  of  Z  enough  times.  These  deterministic  states  are  reachable  from 
anywhere  in  the  state  space  and,  in  particular ,  from  each  other.  Now  we  can 
prove  the  following. 

Proposition  7.  If  2(k)  is  independent  and  identically  distributed  over  k, 
then  the  discrete-state  Markov  Process  (w(k) ,  k«N)  hem  a  single  recurrence 


class. 


Proof;  Assume  more  than  one  recurrence  class  exists.  From  the  previous 
discussion,  each  recurrence  class  must  include  the  deterministic  states. 
This  is  a  contradiction  since  separate  recurrence  classes  do  not  have  states 
in  coranon.  Therefore,  the  tw(k),  ksN}  Markov  Process  has  a  single 
recurrence  class. 

Q.E.D. 


In  this  subsection,  we  have  shown  that  the  w(k)  state  space  is  bounded 
if  the  z(k)  are  bounded  for  all  k.  If  we  also  assume  that  the  z(k)  are  in 
discrete  time,  then  we  conclude  that  the  number  of  w(k)  states  is  finite. 
And  finally,  if  we  also  assume  that  the  z(k)  cure  stationary,  we  conclude 
that  the  resulting  (w(k) ,  k«N)  discrete-state  discrete-index  Markov  process 
has  a  single  recurrence  class  and  a  finite  number  of  states.  Examples 
exist,  however,  of  STDFPNs  whose  relative  firing  times  Markov  process  has 
periodic  states.  Therefore,  we  cannot  conclude  that  this  process  has  an 
ergodic  probability  distribution.  But  we  can  conclude  that 

k 

F(W)  -  }  fK(L)CW> 

k“*  L-l  " 

"  Ifw(kd) (-)  +  fw(kd+l) (-)  +*"+  fw(kd-»d-l ) ( -)  1  (14) 


where  d  is  the  period  of  the  Markov  chain,  converges  [1].  Furthermore,  F(W) 
is  equal  to  the  fraction  of  time  the  process  spends  in  state  W,  that  is 


where  60  is  the  unit  sample  function.  That  is,  F(W)  is  the  unique  state 
occupation  distribution. 

Thus,  we  have  shown  that  the  relative  firing  times  Markov  process  has  a 
unique  state  occupation  distribution.  The  problem  remains,  however,  of  how 
to  calculate  the  performance  measures.  We  will  obtain  these  measures  from 
the  intertransition  times,  which  we  define  next.  We  will  show  that  the 
intertransition  times  have  a  unique  state  occupation  distribution  by 
relating  them  to  the  relative  firing  times. 


An  intertransition  time  is  the  time  between  the  firings  of  two 
transitions  that  have  one  place  in  between  them,  that  is,  it  is  the  time  a 
token  spends  in  a  place.  Consider  the  STDFPN  shown  in  Figure  4,  which  we 
assume  is  part  of  a  larger,  live  and  safe.  STDFPN.  If  we  assume  that  the 
initial  marking  does  not  place  a  token  in  p1#  then  the  time  between  the  kth 
firings  of  transitions  t2  and  t3  is  given  by 

v13(k)  *  x3(k)  -  x^k) 

*  max(z1(k),  z2<k)  +  x2(k)  -  x3(k-l)  +  x3(k-l)  -  x3(k)i  (16) 

where  we  have  used  the  firing  time  state  equations  and  added  a  zero  to  one 
of  the  terms  in  the  maximization  operator .  Now,  place  P2  is  contained  in  a 
directed  circuit  containing  one  token.  By  using  this  fact,  we  can  conclude 
that  x2(k)  -  x3(k-i)  can  be  expressed  as  a  sum  of  intertransition  times 
along  the  specified  directed  circuit.  Similarly,  xx(k)  -  x3(k-l)  can  be 
expressed  as  a  sum  of  intertransition  times  by  noting  that  place  pj  is 
contained  in  a  directed  circuit  with  one  token.  Thus,  we  conclude  that 
v13(k)  can  be  expressed  in  terms  of  the  processing  times  corresponding  to 
the  input  places  of  a  transition  t3,  and  in  terms  of  the  intertransition 
times  along  circuits  with  one  token  containing  transition  t3. 

The  reasoning  used  above  can  be  used  to  write  intertransition  time 
state  equations  among  any  pair  of  transitions.  More  input  places  can  be 
handled  by  using  the  same  argument  given  above  several  times.  And  if  place 
Pi  contains  a  token  in  the  initial  marking,  then  the  definition  of  the 


intertransition  changes  slightly  to  become 


v13(k)  *  x3<k)  “  Xjtk-l) 


The  rest  of  the  reasoning  is  identical. 


As  an  exanple,  consider  the  STDFPN  shown  in  Figure  5.  The  state 
equations  for  the  four  possible  intertransition  times  are 


vn(k)  *  max(z1(k)<  z3(k)  +  v12<k-l)} 


v21(k)  *  max(z3(k),  z2<k)  -  v12(k-l)J 


vl2<k)  «  nax{z2<k),  z4(k)  -  v21(k)J 


v22(k)  -  max{z4(k),  z2(k)  +  v21(k)} 


As  with  the  firing  time  state  equations,  the  intertransition  times  can 
be  calculated  recursively  by  doing  the  calculations  in  the  proper  order  and 
by  initializing  the  process  properly.  The  proper  order  can  be  achieved  by 
using  the  partial  order  established  by  Algorithm  1.  When  a  transition  tj  is 
fired  by  that  algorithm,  all  the  information  required  to  calculate  V£ j ( * )  is 
known  for  all  possible  t^.  To  initialize  the  intertransition  time  state 
equations,  one  must  refer  back  to  the  original  definitions  and  remenber  that 


i 


I 


Since  the  intertransition  times  can  be  calculated  recursively,  we  can 
conclude  that  there  exists  a  transformation  g ( • )  such  that 

v(k)  -  gCz(k),  v(k-l)}  (22) 

where  v(k)  is  the  vector  of  intertransition  times  which  that  tv(k)]j  ~ 
v^j(k)  if  place  pj  is  between  transitions  t^  and  tj.  The  exact  nature  of 
g( * )  is  very  carpi  icated,  but  the  existence  of  such  a  transformation  is 
important  since  it  can  be  used  to  show  the  following: 

Proposition  8.  If  the  z(k)  cure  independent  random  vectors  over  k,  and 
independent  from  v(0),  then  the  (v(k),  k«N)  process  is  Harkov. 

We  derived  the  intertransition  times  since  the  firing  times  process  did 
not  converge  and  since  we  could  not  obtain  the  performance  measures  directly 
from  the  relative  firing  times.  Next  we  will  show  that  the  state  occupation 
distributions  for  the  intertransition  times  will  converge  by  relating  them 
to  the  relative  firing  times,  and  then  we  will  show  how  the  performance 
measures  can  be  calculated. 


27 


J 

i 

[ 

S 

.  • 

v  * 

1 

9 

i 


t, 

b 

► 

r 

i 

i 

.  ,• 


VIII.  TRANSFORMATION  FROM  RELATIVE  TO  IMTEKERANBITION  FIRING  TIMES 

Fran  the  previous  section,  we  note  that  the  intertransition  time 
vector,  v(k),  is  defined  in  terms  of  x(k)  and  x(k-l).  This  inplies  that  for 
every  transition  frcm  x(k-l)  to  x(k),  v(k)  is  uniquely  determined.  Me  will 
now  show  that  something  similar  occurs  with  the  intertransition  times. 

Consider  two  connected  transitions,  t3  and  t3,  of  Figure  4.  There  are 
two  possible  definitions  of  the  intertransition  times,  given  by  equations 
(16)  and  (17).  If  equation  (16)  applies,  then 

vi2(k)  *  x2(k)  -  xr(k)  -  tx2(k)  -  xr(k)3 

-  w2(k)  -  w2(k)  (23) 

If  equation  (17)  holds,  then  we  can  show  by  representing  the  equation  in 
(max,  +)  form,  using  firing  time  state  equation  (4),  and  remenbering  the 
definition  of  relative  firing  times,  that 

vi2(k)  -  w2(k)  ©  (w1(k-l)  0[a^[z(k))0  w(k-l)]"1}-1  (24) 

Thus,  the  intertransition  times  can  be  calculated  by  knowing  w(k-l ) ,  w(k), 
and  z(k). 

So.  analogous  to  the  situation  we  had  with  the  firing  times  process, 
for  every  state  transition  in  the  (w(k),  ksN)  Markov  Process,  the 
intertransition  time  vector  v(k)  is  uniquely  determined.  This  inplies  that 
the  state  occupation  distribution  for  the  intertransition  times,  F(v), 
converges  since,  as  we  saw  previously,  the  state  occupating  distribution  for 


IX.  PggQBMMCEl 


In  the  previous  section,  we  showed  that  the  state  occupation 
distribution  for  the  intertransition  times  process  converges.  Now  we  will 
show  how  to  evaluate  the  performance  measures  of  interest. 

The  easiest  performance  measure  to  calculate  is  Tj,  the  average  time  a 
token  spends  in  place  Pj.  it  is  simply  the  average  of  the  intertransition 
time  corresponding  to  place  Pj.  Thus.  x,  the  vector  of  average  holding 


times  is 


5  »  F(h) 


To  find  Xj ,  the  average  firing  rate  of  transition  tj,  we  must  think 
about  the  way  live  and  safe  STEFPNs  operate.  Due  to  the  liveness  and 
safeness  assumptions,  every  transition  is  contained  in  a  directed  circuit 
containing  one  token.  Thus,  the  average  time  between  firings  of  transition 
tj,  which  we  denote  by  Dj,  is  given  by  the  sum  of  the  average 
intertransition  times  around  the  directed  circuit  containing  one  token.  The 
average  firing  rate  is  then  given  by 


To  make  matters  simpler,  the  consistency  result  for  strongly  connected 
STUfPNs  [13]  implies  that  the  average  firing  rate  for  all  transitions  is 
equal.  Therefore,  all  we  have  to  do  to  find  the  average  firing  rate  is  sum 
the  average  intertransition  times  along  any  directed  circuit  and  invert. 


The  last  performance  measure  of  interest  for  STDFPNs  is  Nj}  the  average 
nunber  of  tokens  place  Pj  contains,  for  all  places.  This  statistic  can  be 
confuted  by  using  Little's  formula  16]  to  obtain 

Nj  -  XTj  (20 

where  X  is  the  average  rate  of  arrival  of  tokens  to  pj  and  tj  is  the  average 
time  a  token  sends  in  pj. 


Consider  the  STDFFN  of  Figure  5,  with  the  processing  tine  z1(k)  being  1 

or  3  with  equal  probability,  Z4<k)  *  2  and  z2(k)  -  z3(k)  ■  0.  we  assume 

these  processing  tines  are  stationary  and  independent  frost  place  to  place 

and  over  stages.  The  intertransition  times  are  given  by  equations  (18) 

through  (21).  As  can  be  noted  from  these  equations,  it  is  only  necessary  to 

iterate  between  p~  /i.)(v)  and  pt.  (i.)  (v) .  Doing  this,  we  obtain  the 
vn'*'  ti 

limiting  distributions  shown  in  Figure  6.  From  these  distributions,  we  find 
that 

rT  -  [13/6  7/6  1  13/6],  X  -  ,  and 


XI.  OONCLDBIONS 


Me  have  shown,  in  this  paper,  that  the  performance  of  a  STDFPN  can  be 
analyzed  by  recursively  calculating  the  probability  distributions  for  the 
intertransition  times,  and  repeating  these  calculations  until  the  state 
occupation  distributions  converge.  Of  particular  note  is  the  development  of 
the  Unfolded  STDFPN.  Unis  unfolded  net  rids  the  problem  of  the 
complications  arising  from  directed  circuits  and  provides  intuition  for  the 
characterization  of  the  different  processes.  Moreover,  it  is  a  concept  that 
is  likely  to  extend  to  broader  subclasses  of  STPNs. 

Finding  the  steady  state  performance  measures  using  the  intertransition 
times  state  equations  is  more  flexible  than  previous  approaches  for  solving 
STPNs,  which  consisted  of  transforming  the  problem  into  an  equivalent  Markov 
Chain.  The  mentioned  state  equations  are  valid  regardless  of  what 
processing  time  distributions  are  assigned.  Thus,  one  could,  for  example, 
solve  the  problem  by  starting  with  gross  approximations  to  the  given 
processing  time  distributions,  perform  the  recursive  computations  until 
convergence,  then  use  the  results  to  start  a  new  set  of  recursive 
computations  using  better  approximations  to  the  processing  times 
distributions^  Such  a  procedure  is  not  possible  using  previous  approaches 
since,  every  time  a  processing  time  distribution  is  changed,  a  new  Markov 
Chain  has  to  be  constructed .  It  is  also  hoped  that  solving  these  state 
equations  recursively  is  numerically  more  stable  than  solving  the  large  sets 
of  linear  equations  associated  with  the  Markov  Chains. 


*This  idea  is  due  to  Ms.  E.L.  Hahne,  whose  cooperation  is  greatly 
appreciated. 
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There  are  severed,  possible  areas  of  future  research.  Extending  the 
analysis  to  broader  classes  of  problems  is  one.  The  efficient  numerical 
implementation  of  the  resulting  algorithms,  an  issue  not  addressed  in  this 
paper,  is  another.  On  a  longer  term,  one  can  think  of  performing  a 
sensitivity  analysis,  doing  aggregation  studies,  hierarchical  decomposition, 
etc.  STPNs  seem  to  be  an  ideal  area  in  which  to  study  many  topics  of 
interest  in  system  theory. 
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